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ABSTRACT 

y 

A  dlteattioa  of  stapling  in  two  diatntiont  and  its  implications  for 
vision  it  prasanttd.  We  show  that  aliasing  in  two  diaensions  will  change 
both  the  apparent  frequency  and  orientation  of  a  grating.  Farther,  we 
deaonstrate  that  the  Nyqaist  frequency  depends  on  orientation  and  is  higher 
than  the  usual  estimate  of  60  e/deg. 


Key  words:  retinal  stapling,  aliasing 
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Thar*  it  •  growing  recognition  that  tha  eharaetaristiea  of  tha  retina 
oonaidarad  a*  a  two  dinensional  aanpling  systen  haw*  aignificant 
eonaaqnancas  for  wision~ (Villians  and  Collier,  1983 Tellott,  1982,  19831 
French,  Snyder  and  Strawenga,  1977;  Birach  and  Hylton,  1983;  Miller  and 
Bernard,  1983).  Although  aanpling  in  on*  dinenaion  i*  generally 
nnderetood,  the  fnndanental  differencee  between  aanpling  in  one  and  two 
dinenaion*  have  not  been  widely  appreciated  in  the  wiaion  literature.  In 
thi*  report  w*  will  briefly  diacnea  the  effect*  of  retinal  aanpling  in  two 
dineneiona  in  order  to  clarify  the  fnndanental  notion*  related  to  wianal 
acience.  Many  of  the  following  idea*  are  well  known  in  other  area*  of 
inaging  acience  (Goodnan,  1968;  Zinan,  1979;  Bipley,  1981). 

A  counon  but  niataken  notion  ia  that  if  the  retinal  photoreceptor 
apacing  ie  1/120  (i.e.  that  the  retinal  aanpling  frequency  is  120/ deg), 

then  aliasing  due  to  aanpling  will  cans*  a  100  e/dsg  sinusoidal  grating  to 
appear  as  a  20  c/ deg  grating  (as*  for  esanple  Tellott,  1982,  1983).  Thi* 
resnlts  fron  applying  a  one  dinensional  answer  to  a  two  dinensional  problen 
without  respecting  the  fnndanental  differencee  between  on*  and  two 
dinensions.  The  nost  fnndanental  difference  is  that  in  one  dinenaion 
spatial  frequency  is  a  scalar  quantity  whereas  ia  two  dinensions  spatial 
frequency  is  a  wector  quantity.  Thus,  Blissing  in  two  dinensions 
generally  inwolwes  a  wector  subtraction  ia  frequency,  which  alnost  always 
changes  the  orientation  of  the  grating  and  certainly  cannot  be  considered 
as  a  subtraction  in  the  nagnitudes  of  the  frequencies. 

The  second  najor  difference  between  one  sad  two  dinensions  is  that 
whereas  a  on*  dinensional  systen  is  fully  characterised  by  a  single 
(scalar)  aliasing  frequency  ,  a  two  dinensional  systen,  which  possess**  two 
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independent  directions,  it  fully  characterised  by  two  linearly  independent 
(vector)  aliasing  frequencies.  Vhile  tbs  two  aliasing  frequencies  nay  have 
tbe  a ana  Magnitude,  they  always  have  different  directions.  In  tbe  case  of 
a  aquare  lattice  tbeir  directions  differ  by  90*  while  for  a  hexagonal 
lattice  their  orientations  can  be  chosen  to  differ  by  either  60*  or  120* . 
The  two  aliasing  frequency  vectors  f on  the  basis  of  a  lattice  in  the 
spatial  frequency  doaain  known  as  the  reciprocal  lattice  which  contains  all 
possible  aliasing  frequencies.  That  is,  the  sampled  values  of  a  sinusoid 
of  frequency  f  are  indistinguishable  from  the  sampled  values  of  a  sinuoid 
of  frequency  f  4  fpi  where  fui,  is  one  of  the  points  in  the  reciprocal 
lattice  (see  appendix).  The  only  ease  in  which  aliasing  corresponds  to 
subtracting  the  magnitudes  of  the  frequencies  occurs  when  the  orientation 
of  the  grating  lines  up  with  the  orientation  of  one  of  the  aliasing  basis 
vectors,  a  very  special  ease.  These  arguments  are  made  more  concrete 
below: 

The  essence  of  the  sampling  problem  is  how  well  the  original 
continuous  function  can  be  recovered  from  a  discrete  set  of  sample  points. 
In  one  dimension  the  answer  is  contained  in  the  well  known  sampling 
theorem:  if  all  the  spatial  frequency  components  of  the  continuous 
function  vanish  outside  the  region  in  frequency  -fg/2  to  fg/2,  where 
fs  is  the  sampling  frequency,  then  the  continuous  function  can  be 
recovered  exactly  from  the  sampled  function  (Braeevell,  1956).  This  result 
la  easily  visualised  interns  of  aliasing  (Braeevell,  1965).  Aliasing 
allows  us  to  add  to  or  subtract  from  the  true  frequency  f  any  multiple  of 
f|.  If  the  total  range  of  frequencies  in  the  true  Fourier  spectrum 


exceeds  fs,  then  aliasing  ean  connect  frequencies  within  the  range 
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resulting  in  anbignltiaa  that  aaka  recovery  of  tha  trna  Fourier  ape ct run 
impossible.  However,  if  tha  total  ranga  of  frequencies  it  loss  than  or 
equal  to  fs  (as  for  -ff/2  to  fg/2),  than  aliasing  cannot  connaet  two 
frequencies  within  tha  ragion  and  ambiguities  do  not  oecnr.  Nota  that  the 
Hyquist  criterion,  which  ia  usually  thought  of  as  tha  frequency  t%n.  is 
actually  the  boundary  of  the  ragion  -fg/2  to  fg/2.  The  boundary  of  a 
one  dimensional  ragion  is,  of  course,  just  tha  and  points.  The  Nyquist 
interval  is  conventionally  chosen  to  include  the  origin,  other  choices  are 
possible.  r 

The  result  for  sampling  in  two  dimensions  is  similar  to  the 
result  in  one  dimension  with  the  differences  previously  noted.  To  avoid 
ambiguities  due  to  aliasing  all  two-dimensional  spatial  frequency 
components  must  vanish  outside  a  region  in  the  frequency  plane.  This 
region  is  determined  by  the  requirement  that  no  two  frequencies  within  it 
can  be  connected  by  any  combination  of  multiples  of  the  two  aliasing 
frequency  basis  vectors.  This  region  turns  out  to  be  a  polygon  in  the 
frequency  plane  (a  square  for  a  square  spatial  lattice  and  a  hexagon  for  a 
hexagonal  spatial  lattice,  if  the  region  is  chosen  to  include  the  origin). 
The  perpendicular  distance  from  the  origin  to  the  aides  of  the  polygon  is 
l/(2d)  for  the  square  lattice  and  1/ (d  SQRT(3))  for  the  hexagonal  lattice, 
where  d  is  the  center-to-eenter  spacing  of  the  spatial  lattice  points. 

These  frequency  polygons  have  the  same  orientation  as  the  apace  lattice  for 
the  two  cases  given.  jFigure  1  shows  the  basis  vectors  for  the  sampling 
(space)  lattice  and  the  reciprocal  lattice  for  the  eases  of  a  square 
lattice  and  a  hexagonal  lattice.  Figure  2  illustrates  the  construction  of 
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tbi  polygon  (known  ns  the  first  Brilloain  none  or  priaitive  coll  in  tke 
rociprocal  lattica)  which  giwos  the  conditions  to  avoid  aliasing.  The 
polygon  is  constructed  by  drawing  lines  froa  the  origin  to  the  points  in 
the  reciprocal  lattice  and  then  drawing  the  perpendicular  bisectors  of 
these  lines.  The  region  inside  the  perpendicular  bisectors  is 
characterised  by  the  property  that  no  two  points  can  be  connected  by  an 
aliasing  vector.  Note  that  the  Nyquist  criterion  is  the  boundary  of  the 
polygon,  and  the  aagnitude  of  the  Nyquist  frequency  depends  on  the 
orientation  of  the  presented  frequency  relative  to  the  saapling  lattice. 

The  orientation  dependence  of  the  Nyquist  frequency  can  be  regarded  as  due 
to  an  effective  one  diaensional  saapling  frequency  which  depends  on 
orientation.  For  the  aquare  lattice,  aliasing  sets  in  at  a  frequency 
between  1  and  8QKT(2)  tines  l/(2d),  depending  on  orientation,  while  for  the 
hexagonal  lattice  aliasing  sets  in  at  frequencies  between  2/SQKT(3)  and  4/3 
tines  l/(2d).  Snyder  and  Miller  (1977)  have  also  noted  that  the  effective 
saapling  frequency  of  a  hexagonal  lattice  is  higher  than  the  one 
diaensional  estiaate  of  the  Nyquist  liait.  Thus  since  the  retinal 
photoreceptors  are  hexagonally  packed  with  eenter-to-center  spacing  of 
approxiaately  1/120*,  aliasing  sets  in  at  frequencies  ranging  froa  (9  to  80 
c/deg,  depending  on  orientation,  not  <0  c/deg  as  is  usually  assuaed.  Thus 
an  optieal  cutoff  frequency  of  60  c/deg  is  well  within  the  saapling  liait 
for  the  fovea. 

Anatoaieal  results  have  shown  that  the  photoreceptor  lattice  is 
hexagonally  packed  (e.g.  Miller,  1979).  Saapling  with  a  hexagonal  lattice 
is  preferable  to  saapling  with  a  square  lattice  for  several  reasons. 

First,  hexagonal  packing  has  a  greater  nuaber  of  saaples  per  unit  area  than 
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square  packing,  leading  to  a  higher  average  Nyqniet  frequency  (greater  area 
in  the  Brillouin  sone).  Second,  the  hexagonal  Brillouin  cone  ia  sore 
nearly  circular  than  the  square  sone  resulting  in  less  severe  dependence  on 
orientation.  A  third  reason  is  sonevhat  speculative.  Ve  have  recently 
suggested  that  hyperacuity  involves  short  range  interpolation  between 
photoreceptors,  possibly  quadratic  interpolation  (Hirsch  and  Hylton. 

1982).  Since  a  two-dimensional  quadratic  has  six  parameters,  such  a 
■echanisa  requires  at  least  six  inputs.  Then  for  a  hexagonal ly  packed 
lattice,  a  photoreceptor  plus  its  six  neighbors  foras  a  natural  grouping 
for  short  range  interpolation,  but  a  square  lattice  would  require  both  the 
nearest  and  the  aore  distant  second  nearest  neighbors  as  input  for 
quadratic  interpolation. 
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APPENDIX 


Mathematical  Details 

Ve  present  here  a  brief  mathematical  derivation  for  aliasing  in  two 
dimensions.  The  derivation  is  closely  related  to  a  basic  result  in  solid 
stste  physics,  where  Fourier  expansion  of  periodic  systems  (crystals)  are 
quite  important.  (See,  for  example,  Kittel,  1971,  fox  a  discussion  of 
periodic  systems,  the  reciprocal  lattice,  and  Brlllonin  zones.) 

The  analysis  starts  from  the  definition  of  a  lattice.  An  N 
dimensional  lattice  is  fully  described  by  the  position  of  one  lattice  point 
(which  we  take  to  be  the  origin)  and  a  set  of  N  vectors,  called  the  basis 
vectors  of  the  lettioe,  which  essentially  give  the  magnitude  and  direction 
of  the  ateps  necessary  to  move  from  one  lattice  point  to  the  next.  An  N 
dimensional  lattice  has  N  linearly  independent  such  steps,  and  every 
lattice  point  has  a  position  given  by 


?  -  I  M,  *  <5. 

i-1  1 


where  the  Mg  are  integers  and  the  di  are  the  basis  vectors  of  the 
lattice.  If  we  present  a  fraqnency  f,  we  measure  the  values  of  the 
sinusoid  only  at  the  set  of  points  given  by  P  above.  Aliasing  occurs  when 
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the  values  measured  at  the  lattice  points  for  a  frequency  f  are  the  same  as 

■4  -4 

for  a  frequency  f  +  fa  for  all  lattice  points.  Thus  aliasing  requires: 


12tt  ?•?  12tt 

e  *  e  • 


or 


i2r?  -P 

e  a 


1 


for  all  lattice  points  (The  i  appearing  in  front  of  2n  is  the 

SQRT(-l) . )  This  leads  to  sets  of  simultaneous  linear  equations  of  the  form 


where  P  is  the  set  of  points  given  above  and  Kp  it  an  integer  which 
varies  from  point  to  point.  Substituting  the  form  for  ^  given  above  leads 
to  the  aquations 


K 


i 


where  i  takes  on  the  values  1  to  N  and  Kf  it  an  integer  which  can  be 
different  for  each  dj.  Although  we  do  not  prove  it  here,  there  are  an 
infinite  number  of  frequencies  1,  which  satisfy  these  conditions.  In 
fact,  the  aolutions  form  a  lattice  in  the  spatial  frequency  domain  known  as 
the  reciprocal  lattice,  and  all  the  are  given  by 
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N 

s 

1-1 


where  the  are  Integers  end  the  l|i  are  the  N  basis  vectors  for  the 
reciprocal  lattice.  Te  will  solve  for  the  for  the  two  diaensional 
case. 

The  aliasing  conditions  for  two  diaensions  can  be  written  as 


Thus  we  require  that  fai  be  perpendicnlar  to  &2  end  have  a 
projection  of  1/dj  onto  the  "di  direction,  and  siailarly  for~^a2* 

These  vectors  can  easily  be  found  by  using  the  cross  product  x  "dj • 

This  is  a  vector  perpendicular  to  both "fcj  and  ^2  (i*»  it  1* 

4  4  4 

perpendicular  to  the  plane  of  the  lattice).  Then  d2  x  (dj  x  d2>  is  a 

4  -4 

vector  in  the  lattice  plane  perpendicular  to  d2  but  not  di,  and  its 

■4* 

length  can  be  chosen  to  have  the  correct  projection  on  dj.  Siailarly, 

-*  -¥  ■*■  -*• 

dj  x  (dj  x  d2)  is  perpendicular  to  di  but  can  be  chosen  to  have 

the  correct  projection  on  ^2.  Thus  we  have  found  the  basis  for  the 

• 

reciprocal  lattice  in  two  diaensions,  and  all  aliasing  frequencies  have  the 
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1 .  *  **1  *  ’.1  *  M2  *  ?.2 


vhne  the  ate  integers.  The  nine  di 


tf  the  sliasii 


frequencies  st  one  of  the  snaple  points  is  then 


ei2r(M1  *  ?al  4  H2  *  ta2)  •  (Nx  *  \  4  N2  *  12) 
.  ei2n(M1N1  4  M2«2)  „  j 


for  ell  ssaple  points.  (N|  and  Mi  ere  integers).  Thns  the  aliasing 

condition  is  act. 
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FIGURE  CAPTIONS 

Figure  1:  Stapling  and  reciprocal  lattices.  The  left  hand  figures  show 
the  basis  for  the  stapling  (space  domain)  lattice  for  square  and  hexagonal 
symmetries.  The  dots  represent  the  points  in  space  at  which  aeasureaents 
are  taken.  The  right  hand  figuras  show  the  corresponding  reciprocal 
(spatial  frequency  doaain)  lattices.  The  points  in  the  reciprocal  lattice 
are  aliasing  frequencies  which  have  the  property  that  two  spatial 
frequencies  differing  by  any  aultiple  of  an  aliasing  frequency  give  rise  to 
identical  values  at  all  the  saaple  points  and  hence  are  indistinguishable. 

Figure  2:  Construction  of  the  first  Brillouin  Zone.  In  order  to  avoid 
aliasing  spatial  frequencies  aust  be  restricted  to  a  region  in  the 
reciprocal  lattice,  the  first  Brillouin  sons,  such  that  no  two  points  in 
this  region  differ  by  one  of  the  aliasing  vectors.  The  boundary  of  this 
region  is  the  equivalent  of  the  Hyq*i*t  criterion  in  one  dimension.  The 
gone  can  be  constructed  by  taking  the  region  around  the  origin  bounded  by 
the  perpendicular  bisectors  of  lines  drawn  from  the  origin  to  the  aliasing 
points.  (See  Kittel,  1971). 
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